Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add dataset info #663

Merged
merged 19 commits into from
Aug 30, 2021
Merged

add dataset info #663

merged 19 commits into from
Aug 30, 2021

Conversation

jin-s13
Copy link
Collaborator

@jin-s13 jin-s13 commented May 20, 2021

It requires mmcv-full (latest version). open-mmlab/mmcv#1083
Blocked by mmcv release.

===================================================================================

  1. Add one dataset_info file for each dataset, e.g. "dataset_info/atrw.py". This file contains all information about the dataset: (1) dataset_name (2)paper_info (3)keypoint_info (4)skeleton_info.
  2. Replace dataset with dataset_info in inference.py.
  3. Change 1-based indexing to 0-based indexing for skeleton.
  4. pose_limb_color -> pose_link_color
  5. add _base_ datasets in mmpose/datasets/datasets/

@codecov
Copy link

codecov bot commented May 20, 2021

Codecov Report

Merging #663 (9567dbb) into dataset_refactor (0ecf06e) will decrease coverage by 1.06%.
The diff coverage is n/a.

❗ Current head 9567dbb differs from pull request most recent head 45b3703. Consider uploading reports for the commit 45b3703 to get more accurate results
Impacted file tree graph

@@                 Coverage Diff                  @@
##           dataset_refactor     #663      +/-   ##
====================================================
- Coverage             83.64%   82.58%   -1.07%     
====================================================
  Files                   178      184       +6     
  Lines                 14195    13694     -501     
  Branches               2367     2321      -46     
====================================================
- Hits                  11874    11309     -565     
- Misses                 1714     1770      +56     
- Partials                607      615       +8     
Flag Coverage Δ
unittests 82.53% <ø> (-1.05%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...se/datasets/datasets/body3d/body3d_base_dataset.py 0.00% <0.00%> (-80.44%) ⬇️
.../datasets/datasets/top_down/topdown_mhp_dataset.py 83.33% <0.00%> (-16.67%) ⬇️
...mpose/datasets/datasets/bottom_up/bottom_up_aic.py 77.41% <0.00%> (-15.61%) ⬇️
...mpose/datasets/datasets/bottom_up/bottom_up_mhp.py 77.41% <0.00%> (-15.61%) ⬇️
...datasets/datasets/bottom_up/bottom_up_crowdpose.py 77.41% <0.00%> (-15.61%) ⬇️
mmpose/apis/inference_tracking.py 59.34% <0.00%> (-9.89%) ⬇️
mmpose/apis/inference.py 50.35% <0.00%> (-9.57%) ⬇️
...s/datasets/top_down/topdown_posetrack18_dataset.py 24.42% <0.00%> (-8.45%) ⬇️
.../datasets/datasets/top_down/topdown_aic_dataset.py 89.74% <0.00%> (-8.44%) ⬇️
...asets/datasets/top_down/topdown_ochuman_dataset.py 85.71% <0.00%> (-7.47%) ⬇️
... and 57 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 0ecf06e...45b3703. Read the comment docs.

dataset_info/atrw.py Outdated Show resolved Hide resolved
dataset_info/atrw.py Outdated Show resolved Hide resolved
@jin-s13 jin-s13 force-pushed the dataset_configs branch from 50c55bc to 1d640bf Compare May 24, 2021 13:40
@jin-s13 jin-s13 mentioned this pull request May 24, 2021
14 tasks
@jin-s13 jin-s13 marked this pull request as ready for review May 27, 2021 12:06
@jin-s13 jin-s13 force-pushed the dataset_configs branch from efa38e3 to 91483a0 Compare June 1, 2021 13:12
@innerlee
Copy link
Contributor

innerlee commented Jun 2, 2021

Another comment: the _base_ name in source code feels not right

image

@jin-s13
Copy link
Collaborator Author

jin-s13 commented Jun 25, 2021

@cherryjm Could you please help add configs/_base_/datasets/mpi_inf_3dhp.py?

@jin-s13
Copy link
Collaborator Author

jin-s13 commented Jun 25, 2021

@zengwang430521 Could you help check the color in configs/_base_/datasets/interhand3d.py, which is used for visualization?

@ly015 ly015 mentioned this pull request Jul 13, 2021
10 tasks
@ly015 ly015 mentioned this pull request Aug 11, 2021
8 tasks
@ly015 ly015 changed the base branch from master to dataset_refactor August 20, 2021 04:15
@innerlee
Copy link
Contributor

Change _base_ folder to base here

image

from mmpose.datasets.pipelines import Compose


class AnimalBaseDataset(Dataset, metaclass=ABCMeta):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Keep a dummy class of AnimalBaseDataset here for compatibility

@@ -108,7 +108,7 @@ def show_result(self,
bbox_color='green',
thickness=2,
pose_kpt_color=None,
pose_limb_color=None,
pose_link_color=None,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Compatibility for this change.

zengwang430521 and others added 3 commits August 25, 2021 10:03
* fix some bugs in the unit test of smpl model.

* reorganize `tests/` to solve importing issue (PEP 420)

* fix deprecation warnings in unit tests

Co-authored-by: ly015 <[email protected]>
* test the simple case using tmux to run multiple benchmark regression test tasks

* modify and rename the config file and script

* Delete config_list.yaml

* modify the config and rename the filename

* Delete test_benchmark_tmux.py

* modify the script and rename the filename

* Update setup.cfg

* using mmcv.load to avoid introducing the extra dependency on yaml

* fix some typo

* refactor the config file and modify the script accordingly

* modify the config and script

* rename the config file
ly015 and others added 16 commits August 27, 2021 10:21
* Add pre-commit hook to automatically add copyright file header

* update files with copyright header

*  Limit copyright checking in the first 2 lines of a file
* Exclude configs in demo/

* set max-header-lines as 5

* rebase to master and add copyright to new files
* move benchmark_regression into .dev_scripts/benchmark
* 2rd PR remove poseval

* fix lint

* revise the CN version

Co-authored-by: ly015 <[email protected]>
* Add bc-breaking test for functions related to dataset_info
* Rename DatasetInfo.dataset_info as DatasetInfo._dataset_info
* Fix dataset_info of h36m dataset
@ly015 ly015 merged commit 321608d into dataset_refactor Aug 30, 2021
@innerlee innerlee deleted the dataset_configs branch August 30, 2021 07:16
ly015 added a commit that referenced this pull request Sep 2, 2021
* Fix import and deprecation issues in unit tests (#871)

* fix some bugs in the unit test of smpl model.

* reorganize `tests/` to solve importing issue (PEP 420)

* fix deprecation warnings in unit tests

Co-authored-by: ly015 <[email protected]>

* add benchmark regression test script with tmux (#849)

* test the simple case using tmux to run multiple benchmark regression test tasks

* modify and rename the config file and script

* Delete config_list.yaml

* modify the config and rename the filename

* Delete test_benchmark_tmux.py

* modify the script and rename the filename

* Update setup.cfg

* using mmcv.load to avoid introducing the extra dependency on yaml

* fix some typo

* refactor the config file and modify the script accordingly

* modify the config and script

* rename the config file

* Correct dataset preparation guide of WFLW (#873)

* add pr template (#875)

* add CITATION.cff and update setup.py (#876)

* Add copyright header and pre-commit hook (#872)

* Add pre-commit hook to automatically add copyright file header

* update files with copyright header

*  Limit copyright checking in the first 2 lines of a file
* Exclude configs in demo/

* set max-header-lines as 5

* rebase to master and add copyright to new files
* move benchmark_regression into .dev_scripts/benchmark

* Translate tasks/2d_body_keypoint.md (#842)

* 2rd PR remove poseval

* fix lint

* revise the CN version

Co-authored-by: ly015 <[email protected]>

* fix some bugs in the unit test of smpl model.

* * reorganiz `tests/` to solve importing issue (PEP 420)

* add dataset info

* fix lint

* * fix wrongly modified parts in previous rebase
* fix lint

* rename datasets/_base_ as datasets/base

* resolve compatibility of pose_limb_color

* Add dummy dataset base classes with old names for compatibility

* * Rewrite relative unittest based on dataset_info
* Add bc-breaking test for functions related to dataset_info
* Rename DatasetInfo.dataset_info as DatasetInfo._dataset_info
* Fix dataset_info of h36m dataset

* Handle breaking change pose_limb_color -> pose_link_color

* add unittest for old-fashioned dataset initialization without dataset_info

* resolve naming conflict in unittests

Co-authored-by: zengwang430521 <[email protected]>
Co-authored-by: ly015 <[email protected]>
ly015 added a commit that referenced this pull request Sep 7, 2021
* add dataset info (#663)

* Fix import and deprecation issues in unit tests (#871)

* fix some bugs in the unit test of smpl model.

* reorganize `tests/` to solve importing issue (PEP 420)

* fix deprecation warnings in unit tests

Co-authored-by: ly015 <[email protected]>

* add benchmark regression test script with tmux (#849)

* test the simple case using tmux to run multiple benchmark regression test tasks

* modify and rename the config file and script

* Delete config_list.yaml

* modify the config and rename the filename

* Delete test_benchmark_tmux.py

* modify the script and rename the filename

* Update setup.cfg

* using mmcv.load to avoid introducing the extra dependency on yaml

* fix some typo

* refactor the config file and modify the script accordingly

* modify the config and script

* rename the config file

* Correct dataset preparation guide of WFLW (#873)

* add pr template (#875)

* add CITATION.cff and update setup.py (#876)

* Add copyright header and pre-commit hook (#872)

* Add pre-commit hook to automatically add copyright file header

* update files with copyright header

*  Limit copyright checking in the first 2 lines of a file
* Exclude configs in demo/

* set max-header-lines as 5

* rebase to master and add copyright to new files
* move benchmark_regression into .dev_scripts/benchmark

* Translate tasks/2d_body_keypoint.md (#842)

* 2rd PR remove poseval

* fix lint

* revise the CN version

Co-authored-by: ly015 <[email protected]>

* fix some bugs in the unit test of smpl model.

* * reorganiz `tests/` to solve importing issue (PEP 420)

* add dataset info

* fix lint

* * fix wrongly modified parts in previous rebase
* fix lint

* rename datasets/_base_ as datasets/base

* resolve compatibility of pose_limb_color

* Add dummy dataset base classes with old names for compatibility

* * Rewrite relative unittest based on dataset_info
* Add bc-breaking test for functions related to dataset_info
* Rename DatasetInfo.dataset_info as DatasetInfo._dataset_info
* Fix dataset_info of h36m dataset

* Handle breaking change pose_limb_color -> pose_link_color

* add unittest for old-fashioned dataset initialization without dataset_info

* resolve naming conflict in unittests

Co-authored-by: zengwang430521 <[email protected]>
Co-authored-by: ly015 <[email protected]>

* fix typo

* fix typo

Co-authored-by: Jas <[email protected]>
Co-authored-by: zengwang430521 <[email protected]>
shuheilocale pushed a commit to shuheilocale/mmpose that referenced this pull request May 6, 2023
* add dataset info (open-mmlab#663)

* Fix import and deprecation issues in unit tests (open-mmlab#871)

* fix some bugs in the unit test of smpl model.

* reorganize `tests/` to solve importing issue (PEP 420)

* fix deprecation warnings in unit tests

Co-authored-by: ly015 <[email protected]>

* add benchmark regression test script with tmux (open-mmlab#849)

* test the simple case using tmux to run multiple benchmark regression test tasks

* modify and rename the config file and script

* Delete config_list.yaml

* modify the config and rename the filename

* Delete test_benchmark_tmux.py

* modify the script and rename the filename

* Update setup.cfg

* using mmcv.load to avoid introducing the extra dependency on yaml

* fix some typo

* refactor the config file and modify the script accordingly

* modify the config and script

* rename the config file

* Correct dataset preparation guide of WFLW (open-mmlab#873)

* add pr template (open-mmlab#875)

* add CITATION.cff and update setup.py (open-mmlab#876)

* Add copyright header and pre-commit hook (open-mmlab#872)

* Add pre-commit hook to automatically add copyright file header

* update files with copyright header

*  Limit copyright checking in the first 2 lines of a file
* Exclude configs in demo/

* set max-header-lines as 5

* rebase to master and add copyright to new files
* move benchmark_regression into .dev_scripts/benchmark

* Translate tasks/2d_body_keypoint.md (open-mmlab#842)

* 2rd PR remove poseval

* fix lint

* revise the CN version

Co-authored-by: ly015 <[email protected]>

* fix some bugs in the unit test of smpl model.

* * reorganiz `tests/` to solve importing issue (PEP 420)

* add dataset info

* fix lint

* * fix wrongly modified parts in previous rebase
* fix lint

* rename datasets/_base_ as datasets/base

* resolve compatibility of pose_limb_color

* Add dummy dataset base classes with old names for compatibility

* * Rewrite relative unittest based on dataset_info
* Add bc-breaking test for functions related to dataset_info
* Rename DatasetInfo.dataset_info as DatasetInfo._dataset_info
* Fix dataset_info of h36m dataset

* Handle breaking change pose_limb_color -> pose_link_color

* add unittest for old-fashioned dataset initialization without dataset_info

* resolve naming conflict in unittests

Co-authored-by: zengwang430521 <[email protected]>
Co-authored-by: ly015 <[email protected]>

* fix typo

* fix typo

Co-authored-by: Jas <[email protected]>
Co-authored-by: zengwang430521 <[email protected]>
ajgrafton pushed a commit to ajgrafton/mmpose that referenced this pull request Mar 6, 2024
* add dataset info (open-mmlab#663)

* Fix import and deprecation issues in unit tests (open-mmlab#871)

* fix some bugs in the unit test of smpl model.

* reorganize `tests/` to solve importing issue (PEP 420)

* fix deprecation warnings in unit tests

Co-authored-by: ly015 <[email protected]>

* add benchmark regression test script with tmux (open-mmlab#849)

* test the simple case using tmux to run multiple benchmark regression test tasks

* modify and rename the config file and script

* Delete config_list.yaml

* modify the config and rename the filename

* Delete test_benchmark_tmux.py

* modify the script and rename the filename

* Update setup.cfg

* using mmcv.load to avoid introducing the extra dependency on yaml

* fix some typo

* refactor the config file and modify the script accordingly

* modify the config and script

* rename the config file

* Correct dataset preparation guide of WFLW (open-mmlab#873)

* add pr template (open-mmlab#875)

* add CITATION.cff and update setup.py (open-mmlab#876)

* Add copyright header and pre-commit hook (open-mmlab#872)

* Add pre-commit hook to automatically add copyright file header

* update files with copyright header

*  Limit copyright checking in the first 2 lines of a file
* Exclude configs in demo/

* set max-header-lines as 5

* rebase to master and add copyright to new files
* move benchmark_regression into .dev_scripts/benchmark

* Translate tasks/2d_body_keypoint.md (open-mmlab#842)

* 2rd PR remove poseval

* fix lint

* revise the CN version

Co-authored-by: ly015 <[email protected]>

* fix some bugs in the unit test of smpl model.

* * reorganiz `tests/` to solve importing issue (PEP 420)

* add dataset info

* fix lint

* * fix wrongly modified parts in previous rebase
* fix lint

* rename datasets/_base_ as datasets/base

* resolve compatibility of pose_limb_color

* Add dummy dataset base classes with old names for compatibility

* * Rewrite relative unittest based on dataset_info
* Add bc-breaking test for functions related to dataset_info
* Rename DatasetInfo.dataset_info as DatasetInfo._dataset_info
* Fix dataset_info of h36m dataset

* Handle breaking change pose_limb_color -> pose_link_color

* add unittest for old-fashioned dataset initialization without dataset_info

* resolve naming conflict in unittests

Co-authored-by: zengwang430521 <[email protected]>
Co-authored-by: ly015 <[email protected]>

* fix typo

* fix typo

Co-authored-by: Jas <[email protected]>
Co-authored-by: zengwang430521 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants